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The evaluation of the traffic safety curriculum as 
presented to K-^ students in Horth Carolina focused on three areas: 
(1) the extent to which "Students acquired. the infoCiation included in 
the curriGuluBr ' (2) the extent to which students shpwed a change in 
their actual pedestrian and bicyclist behaviojf, and. (3) the extent to 
which teachers na^e use of the curriculuii 'fiatesials* The extent of 
knowledge ye^ neasured through a conparative test , of experiiental and 
coiitrol groQps of Grades 3^ 6, and 9 students*- A filaing systen was 
developed to cecord actual ped?s'trian and bicyclist behavior of 
students fro* expfeTioental and control schools. .Finally, 
questionnaires were deyeloped to ^eteraine the attitude o^ teachers 
towards the curriculua* materials. The findings of the* study revealed 
the following: (IJ, Graaes 3*^and 6 students " exposed ' to the curriculua 
'showed significant increases in knowledge compared to students in 
control schools, bixt no ^ig'nificant differences were found at the 
Grade 9 level, (2) the behavior observed did ndt show the type of 
effects expected, and -(3) the results of the questionnaire (90. 5S 
return) indicate that traffic safety curricqluo was generally 
accepted and used by teachers. (Author/SC) 
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Under the direction of Research Triangle Institute, traffic safety 
cjrricwl unf was developed for us^ in kindergarten tl)rough ninth grades. 
Through workshops, teachers were involved in the curriculum development 
from the^Deginning. This curriculum was pilot tested in fd4irt?er^ubl ic ^ 
schools in the eastern and western areas of North Carolina, and wa\ taugh't 
by both workshop and nonworkshop participants. The purpose of the \alua- 
tive research described below was tO determine the effectiveness of the 
curriculum to provide input for the revision of curriculum materials. 



METHODOLOGY 



The evaluation qf the kindergarten through nir>th grade traffic safety 
curriculum was conducted in three parts. The first concerned the extent, 
to which 'the stpdent^ acquired the information included in the curriculun; 
that is, how mufch did they learn. The secojid concerned the extent to 
which the students st^^owed a change in their actual pedestrian and bicycl "st 
behavior. The 'third part of the evaluation concerned the extent to v/hich 
teachers actually m^de use of the curriculum materials and what changes 

..they would recpmmenfcl. ' ' ' 

/ 

To determine the extent of knowledge increase, ^tests were developed 
for the thirdi sixp, and ninth grade level's bas^ on the curri^culum con- . 
tent. Forty /items/ were developed at each. designated grade level. The 
schools in wfi^ich ifhe curriculum was being taught were designated experi- 
mental schools. Control schools were selected from within the same school 
systems and 6n the ba^sis of input from the local teachers and adminfstrators 
as to which |5choo/ls could be considered comparable. Within each,^grade 
level., four , school s were used, two* designated as experimental and two as 
control. T6 insure better geofraphic coverage of the state, for e^ch grade 
level, e^cpe^imenjcaTancl contrpl schopls were equally distribi^t^ between 
the eastern, and /the western areas, three classes were tested within each 
school, resulting in a total of twelve classes tested for each grade level. 
Twenty test items at each grade level were randomly chosen for pretests 
which were'administered at both experimental and control schools early in 
the semester. /'\fter the curriculum had o^n taught In the experimental 



scnools, post-tests including all forty items at each grade level were 
administered to the sajne students previously tested.. 

The analysis of these data was designed to answer a basic question: 
How mucn knowledge did the student acquire as a result of the program? 
A statistical test {2-tailed t test for paired data) was chosen to indicate 
whether the change in amount of knowledge was great enough to be signifi- 
cant. 

Table^l 'lustrates the evaluation design used. 



Table 1. Design for knowledge testing. 



5efor;g*^Cjrricu]un 

Trea tment 

After curriculurn 



Experimental School s 

Pre-test ^ 
Exposure to curriculum 
Post-test 



Control SchooU 
Pre-test 

No exposure to curriculum 
Post-test 



In the second part of the evaluation, a filming system was developed * 
and utilized for recording the pedestrian and bicyclist behavior in the 
school area, again before and after the curriculum was as^. 'Observations 
were 'filmed at two elementary schools, one control and one experimental 
school in the same school district. Schools were selected to" be filmed 
on the basis of their covering the same grade levels, ^nd having children 
walking and riding bicycles home from school. Again input from the local' 
teachers and administrators was used .in the selection of these School s . 

A super 8 movie cimera on a tPipod was ^ed. It was placed at ^n • 
obscure, elevated location near the^ schools* crosswallcs. Thfe camera was 
turned on and off with a ten-foot cable release.. Thus, the children 
were unaware that they were'being filmed. The total filming time was 
approximately four minutes; however, this represents abotft 15 minutes of 
behavior since the camera was operated only when the children were actually 
crossing the street. • . ' 

It could be argued that the crosswalk outside the school may not be 
^the most appropriate place to be fi Iming .observations , >si nee students , are 
'more likely to be involved in traffic crashes several bloc'ks away from the 
school rather than right r\^\t to it. However, filmed observations at loca- 
. tion<; more remote from the school ground would yield relatively few obser- 
vations at a corresponding increase in cost.' Furthermore, if a traffic 
safety c-urriculum is to have any fmpact it might be expecte(i that the great- 
est effects would be apparent closest to the school. Consequently in order 
to maxihize the possibility of. observing an effect of the traffic safety 
curriculum, the decision was mde to film students at the crosswalks next 
to the schools. -a 
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Films Were macle-m Septenber, and again ,in February. It was anticipated 
tr.at there mfght Be sea'sonal variations in students' behavior ^at the cross- 
walKS, that is, in the springtime the- students might be more active than ~ 
earlier in»the.year. A control school was* included in the design to take 
into account any such seasonal effects. In addition, at both schools both 
before and after the curriculum was taught, the films were made in bright 
clear weather. ' ^ 

. A coding sheet was developed for recording observations of the filmed 
pedestrian anc bicyclist behavior. The sheet provided ^pace for tallies of 
trie following: - ^ 

^y, stjaents walking across the street 

'2 si^de^its running across the street 

'3, : tjdents ^wa 1 king bikes across street 
students ^nding bikes across street 

[S: Students . reT^a in ing on curb until petrol indicated right- 
of-way 

,'6; students failing to regain on curb until patrol indicated 

right-of-way ' " ^ - 

[7, students .crossing within the narked cro^swajks 
;'5) students -crossing outside the marked crosswalk? 

Tne behaviors nurnbered 1^ 3, 5, and 7 were drawn directly from the 
Cufriculur; materials and'were among those behaviors the curriculum was 
atte-TOting to foster. ^ 

if a student engaged in unsafe behavior at -any point whije cros'sinq 
tne intersection (see nTjm(>ers 2l 4, 5, and 8), only his unsafe behavior 
was recorded. Fop example, if in crossing, a student wa-lked three quarters 
o^\he way, and ran the l.ast quarter, he was counted as running. 

To increase the reliability o-f the observations ^made, a panel of 
/three judges was selected. to view the films. The judges were not told 
whicn school. was experimental and which was(control . First, the films were 
yiev/ed and the observations recor»ded by each judge independently. A. mea- 
sure of the jnter- judge reliability (the ratio of wi thift/varia|:ion to total 
??ariation) indicated high agreement. , ' 

After ^he judges had independently recorded their observations., they 
CGnnp<jred their separate sets of observation data. The films were then<. 
viewed ^gain, observations discussed, and discrepancies resolved. 

Table 2 illustrates the design used. 





Table 2^ Design 'fbr behavioral observations. 



Expertmental School 



Control School 



Before curriculum 



Bicyclist & pedestrian 
behavior fihned 



Bicyclist & predestrian 
behavior filmed 



1 rea tr:ent 



Exposure to curriculum 



No exposure .to curriculum 



After curriculum 



Bixyclist & pedestrian 
ben^ior filmed 



Bicyclist & pedestrian 
behavior filmed. 



For f^.e tni>^d part of the evaluative study, questionnaires were 
developed for grade levels K-3, 4-6, 7, 6, and 9 to dete— .iJie: ,(1) how use- 
ful the ma^terials were; -(2) how much they were actually used; .(3) which 
parts were not used .and why;, and" (4) whart changes the teachers" would 
recommend. 

The fourteen experimental school' prtncipals provided a listing pf all 
the tearfiers in t/ieir schools involved in the K-9 traffi.c safety program,.- 
Each of these teachers was mailed a questionnaire. All ques.tionnaire 
responses were feco/^ded. ' ' • 



Knowledge Acquired 

The students exposed t6 the curriculum at the third and sixth grade 
levels showed significant increases in knowledge compared to students in 
control schools. However, do. significant. differences were found between 
the two groups oTi -the ninth grade level. ^ « 

There are a number of possible contributing* factors which may account 
for the failure to observe an increase .in knowledge at the ninth grade 
1 evel . ^ 'These included, first, t'be higher attrition rate^between pre-tests 
and , post- t;ests at the«n.inth .grade- level . The analysis used included only 
those students for whom both a».pre-test and a post-test were obtained. At 
grade 3 there was ^ 22 perfCenj: loss o^ students between pre-testing aj|jj 
post-testing compared with a N percent J-9^ at grade 5 and a 44 percent 
"loss at grade 9. Second, theVe'were relatively fewer traffic Safety teachers 
for the ninth grade, thus necessitating larger classes ^and possibly making 
it more difficult^td communicate the information. Third, the ninth grade 
'Students may*have had more difficulty recalling information because the 
curriculum w^s presented- for only'thre^ weeks in the ninth grade, while for 
the elementary grades- it was spread' over several months. From-the data, 
t^ere is no way of knowing how lonq the interval was between the comple- , 
tion of the ninth grade mini-course and the post-testing of the students. 
Sihce retention is likely to vary with the lengt>3 of time since the 



FINDINGS 



curriculun was completed, this factor could have affected the findings. 
Fo.urin, information obtained from the teacher -questionnaire indicated that 
the ninth grade teachers were less satisfied with the curriculum" materials . 
Fifth, there appeafred to be more confusion concerning the administration 
of the 7-9 traffic -safety program cornparison to the other levels. To 
illustrate, an eighth grade teacher reported that the ninth grade 'teachers 
in her school requested that the traffic environment materials (designed 
for- grade eight) not be taught in the eighth grade. A^ninth grade teacher 
ref>orted teaching the unit "along with tne driver education work," when 
the unit was : si.gned as a pre-driver education mini -course. This same 
teac>ier report^ a teaching traffic safety from her workshop notes before 
^'eceiving the curriculum and. before the pre-tests. Sne was apparently 
instructed to follow this procedure. After sne had received the curriculum, 
nowever, she taught the material from that. However, v.hen the findings were 
examined for grade 9, with the test scores fror: this school omittecr^ ■ there 
was still no . indicaniion of an increase in knowledge. In addition, one 
eighth ^rade teacher in an experimental schoo' reported on the question- 
naire that sh^ was unaware of the existence of the traffic safety curricu- 
ijri even though she was teaching in, an experimental school. Thes« ?^o- , 
Dlens could, to varying degrees, be alleviated in the expanded use of the 
traffic safety curriculum. Hopefully sucPi efforts would lead to a greater 
inpact of the curriculum at the ninth grade level. 



Benavior Obs erved 

The limited observations which we did obtain of students leaving 
school did not show the type of effects that would be hoped for. 

^or both exDenmental and control schools, a greater proportion of the 
^.nildren were running, and a sma'Vler proportion of the children v/ere cross- 
ing outside the marked crosswalks in thf^ post-curriculum films' as compa;\^a 
to the pre-curriculum films. In addition, a large proportion, 89 percen\ 
or greater,- remained on the curb until the patrol indicated the right-of- 
way in all the f ilms--e/perimental and control schools, before and after 
the curriculum. 'No comparisons can be made relevant to the bicycle 
behavior, however, because of the very small frequency of bicyclists in t<ie 
experimental f i 1ms . 

Tnpse results must be interpreted with caution, howeve^, because the 
rtumber of observations were not sufficient to draw firm conclusions. The^^e 
were on]/ 14 .pilot'* schools from which to s'ample,' and eight of those 
schools were in the mountains of North Carolina where students are bused. 
Of 'the S]x remaining schools, all in the east, only two, y/ere strictly 
elementary (grades 1-6). Therefor?, the behavioral facet of the evaluation 
is pres(^nted primarily for its methodological interest. 

Teacher Responses x * ^ \^ ' 

Tho quooti.onnaire was mailed to all the teachers using the cumcui urn. 
Of*the teachers contacted, 90.5 percent" compl et^d and returned the question- 
naire. " . * • . 
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For ihe fnost part, , the workshop apd nonworkshop teachers on all -grade 
levels rated the curriculum "good," used it "considerably or "sorr^ewhat, " 
found using the materials to be "reasonable, and considered the suggested 
activities *'most helpful" and the curriculum films "least helpful. " In 
general, both workshop and nonworkshop l^eac^ers used the curriculum '•both" 
as d -separate unit and integrated into the existing curriculum, on grade 
levels K-6; and "solely" as a separate unit ^grade levels 7-9. 

Cf importance, -overall a larger proportion of the workshop ,part'ici- 
pants used the materials than the nonworkshop teachers. The materials tnat 
were reported unused by the majority of both groups of teachers, workshop 
^.nd nonworkshop, focused on the areas of farm machin'^ry and'minicycle 
safety for grades 4-6, tractor safety for grade seven, arid auto trip plan- 
ning for grade 8. The major reason given for non use was inadequate tine. • 
Ot'-'or reasons included lack of relevance for tne pariicjlar students 
_ involved. 

Seventy-seven percent of the teacners returning tnr- qjestionnaire 
provided recommendations for changes as ^'ell as comrr.ents about the curncii- 
lun. These comments alone were indicative of a high interest and concern 
anong tne teachers. Among the recommendations from the teachers, tnose 
, Tiost frequency expressed included the desire for additional and more 
readily available audio-visual materials; ready-made masters for reorodjc- 
tion with larger and less. crowded type; simpler^student activities in 
general . * 

In sumnary, the results indicate tnat a traffic safety curricjlum was 
develdp.ed that was generally accepted and used by the teachers.. Furtherrr.ore , 
at the elementary level it was' associated with significant increases in 
. traffic sa'^ety knowledge on the papt of the students. Hoover, the limited 
:reasures that were made of the actual student pedestrian and bicyclist 
bena^pr failed po show an effect of the curriculum. Because of the limted 
, behavioral observations that were obtained, it would i>G premature to arrw 
at any firm conclusions concerning the impact of the curriculum on-4)ehavor. 
The size of the sample observed was such that only a fairly marked cnang. 
in behavior would have been detected. Therefore the behavioral observations 
should be considered primarily in terms of whatever i<iiterest they may have 
■ . from a methodological standpoint. 

« 

The traffic safety curricul um w^s conducted as a pilot project initially 
because it was generajlly agreed that we did not know at this/ime the best 
pos':ible way to teach such a curriculum. The Evaluation of this pilot 
effort was conducted with the purpose of providing information on which to 
base recommendations and changes in the'curricul um. While recognizing that 
no evaluation is conclusive, the followfng recommendations- were offered 
/or consideration in the expansipn and revision of the traffic safety curri- 
'culum. ^] 

1. Curriculum revisions should jnclude greater ^ocuz on 
..^betiiavioral practice of the traffic safety principles being 
/ taught. This recommendation is more easily made than 
*r implemented. To provide behavioral practice in traffic 
safety principles may require facilities other than the 
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traditional classroom. At th'e^ .elementary level the physi.cal 
education period could offer one opportunity. 

because the curriculum is just one.^approa'ch to traffic 
safety and like any, other approach has. its limitations, it 
was also recommended that exploration be made af possi-, 
bilities involving individuals'other than classroom 
teachers in instruction in saf^ traffic 'behavior. Perhaps 
the school patrol could be provided with training that 
would enable them to reinforce'th'e instruction being given ' 
in the traffic safety curriculum. Likewise, school bus , 
drivers could perhaps become involved as liason personnel 
in providing additional real world instruction in safe 
passenger and pedestrian behavior. Other Comrtinity mem- 
bers possibly could be involved as aides to teachers in pro- 
viding students with on-the-scene instruction in traffic 
safety. ^ 

Because the implementation of the curriculum was relatively 
smooth at the elementary, school level, because the results 
looked most promising at this, level, and because there 
appear to. be, considerable problems in the administration. of 
the curriculum at the junior high level, serious consider- 
ation ^should be given to focusing available resources on 
ttie efementary school level an4 omitting the junior high 
program. The statistics concerning the age of pedestrian 
injuries and deaths would support such a focus. * 



